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ABSTRACT 


A  random  translaCion  of  a  marked  point  process  is  considered. 
The  random  translation  is  assumed  to  be  dependent  upon  the 
mark  through  a  certain  function The  main  concern  is 
to  study  the  form  of  the  function^ti(*T^ for  different  types 
of  data.  Complete  identification  is  not  generally  possible 
but  some  interesting  particular  solutions  are  presented. 


1.  INTRODUCTION 


1.1  Some  Essential  Definitions 

Definition  1: 

A  point  process,  I  ,  is  a  stochastic  process  {I(t);t  >.0}  defined 
over  a  fixed  probability  space  (ft,F,P)  so  that,  for  almost  all  weft, 
the  mapping  t  I(w,t)  is  non-decreasing,  right  continuous,  nonnegative, 
finite,  integer  valued,  and  has  l(v,0)  -  1(0)  ■  0  . 

Such  a  process  increases  by  jumps  only,  and  the  times  of  jumps  will  be 
called  the  "points"  of  I  .  In  particular,  a  point  process,  I  ,  with 
"points"  ig**,l’  •••  Is  called  a  renewal  process  if  i^.i^  “  1 2 »  •••  are 
independent  and  Identically  distributed  (l.i.d.)  random  variables.  A 
sequence  (ik  ;  k  «  0,1,  ...}  is  usually  called  a  realization  of  the  point 
process  (ifc  e  ,  the  positive  real  numbers  with  zero  Included) .  A  point 
process  can  be  operated  on  and  changed  into  another  point  process  in  several 
ways.  Examples  of  operations  on  point  processes  are  "superposition",  "ran¬ 
dom  deletion"  and  "random  translation". 

Definition  2; 

A  randomly  translated  point  process  V  ,  derived  from  an  initial  point 
process  I  ,  is  a  point  process  with  realizations  (i^  +  Yfc  ;  k  »  0,1,  ...} 
where  the  sequence  {Yfc  ;  k  -  0,1,  . . . }  is  a  family  of  i.i.d.  random  var¬ 
iables  and  independent  of  the  realization  {i^  ;  k  ■  0,1,  ...}  of  I. 

For  more  details  about  point  processes,  see  Lewis  [9]. 

A  more  general  type  of  point  process  is  the  marked  point  process. 
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Definition  3: 

A  marked  point  process  is  a  point  process  with  an  auxiliary  variable, 
called  the  mark,  associated  with  each  point. 

The  mark  can  be  a  random  variable,  a  random  vector,  or  even  a  random 
process.  The  mark  is  used  to  identify  random  quantities  associated  with 
the  point  process  it  accompanies.  An  example  of  a  mark  is  the  velocity 
and  acceleration  of  a  vehicle  passing  an  observer  at  a  given  instant.  These 
processes  were  Introduced  by  Konig  and  Matthes  [7]. 

1.2  The  Model 

Let  {I^.L^.Y^  ;  k  ■  0,1,  ...}  be  three  sequences  of  nonnegstive 
continuous  random  variables.  The  first  two  random  variables  define  the  so 
called  "input  process",  which  in  this  case  consists  of  the  "arrival  process" 
and  "the  marks"  associated  with  it.  The  input  process  is  assumed  to  be  a 
marked  point  process  and  the  arrival  process  is  the  corresponding  point 
process.  (The  sequence  {1^  ;  k  -  0,1,  ...}  represents  the  inter-arrival 
times,  chat  is  to  say  the  length  of  time  between  two  consecutive  jumps  in 
the  process  {I(t);t  >_  0}  ,  and  ■  1^+^  -  i^  for  k  »  0,1,  ...  where 
ig  is  assumed  to  be  zero.)  The  sequence  (L^  ;  k  -  0,1,  . . .  ;  Lq  «  0}  , 
represents  the  marks  associated  with  the  arrivals  (L^  represents  the  mark 
of  the  k-th  arrival).  This  sequence  is  a  sequence  of  mutually  i.i.d.  ran¬ 
dom  variables  which  are  also  independent  of  the  instants  of  arrivals  i^'s  . 
The  distribution  function  of  the  marks  is  denoted  by  P(x)  .  The  random 
variables,  Y^'s  ,  define  the  random  translations  (Y^  represents  the  ran¬ 
dom  translation  of  the  k-th  arrival  which  has  occurred  at  the  instant  1^ 
with  the  mark  L^) .  The  sequence  {Y^  ;  k  -  0,1,  . . .  ;  Yq  ■  0}  is  assumed 
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Co  be  a  sequence  of  l.i.d.  random  variables  which  are  independent  of  che 
Instants  of  arrival.  In  this  paper,  we  assume  the  existence  of  a  certain 
function  h(*)  such  that  the  random  variables  Y^'s  depend  on  the  marks 
In  the  following  way: 

x  ^  0 

for  k  »  1,2,  ...  .  (1) 

x  <  0 

The  h(*)  is  a  function  relating  the  mark  of  the  arrival  to  the  parameter 
of  the  exponential  distribution  which  define  the  conditional  distribution 
function  of  the  random  variable  •  Let  d^  be  the  point  of  the  trans¬ 
lated  point  process  V  ,  corresponding  to  the  point  i^  of  the  point  proc¬ 
ess  I  .  By  Definition  2,  we  have: 

dfc  *  *k  +  Yk  for  k  “  °»1 .  (2) 

The  sequence  {D^  ■  ~  d^  ;  k  «  0,1,  •••)  represents  the  time  between 

two  consecutive  points  of  the  translated  point  process  V  . 

The  mathematical  model  defined  above  is  a  random  translation  of  a 
marked  point  process. 

1 . 3  Principal  Results 

Several  questions  of  a  probabilistic  and  statistical  kind  can  be  asked 
in  relation  to  this  model.  In  this  paper,  our  main  concern  is  to  study  the 
form  of  the  function  h(*)  for  different  types  of  data. 

Complete  identification  is  not  generally  possible,  but  it  will  be 
shown,  for  example,  that  maximum  likelihood  estimators  (m.l.e)  can  be  found 
for  some  interesting  particular  situations.  In  Section  2,  a  formal  solution 


P[Yfc  <  x  |  I*  -  *]  - 


,  -h(£)x 

x  —  e  > 
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is  presented  where  the  study  of  the  fora  of  h(-)  is  related  to  the  prob¬ 
lem  of  identif lability  and  estimation  of  the  service  time  distribution 
function  of  the  G/G/®  system.  For  uniformly  distributed  marks,  a  solu¬ 
tion  is  given.  In  Section  3,  the  input  process  is  restricted  to  a  marked 
non-homogeneous  Poisson  process  and  it  is  proved  that  the  total  number  of 
transitions  (arrivals  and  departures  from  the  M/G/®  system,  regardless 
of  their  marks)  during  a  fixed  time  interval  (0,t]  is  a  Hermite  random 
variable.  This  result  is  of  independent  Interest  and  holds  for  any  in¬ 
finite  server  system  with  non-homogeneous  Poisson  arrival  process  and 
general  service  time  distribution.  The  fora  of  the  function  h(*)  is 
assumed  to  be  known,  apart  from  a  certain  number  of  unknown  parameters, 
and  m.l.e.  can  be  found  for  these  parameters  and  the  basic  parameters  of 
the  arrival  process  when  working  with  not  more  than  two  unknown  parameters. 
Moreover,  the  data  required  by  these  estimators  is  just  the  total  number 
of  indistinguishable  arrivals  and  departures  from  the  system  during  a 
fixed  time  interval.  A  discussion  will  be  found  in  Sections  4  and  5  con¬ 
cerning  other  types  of  data,  namely,  observations  just  of  the  instants 
of  departures  during  time  interval  (0,t]  and  direct  observations  of  the 
service  times. 

1.4  The  Corresponding  G/G/°°  System 

If  we  don't  know  the  marks  of  the  arrivals,  our  model  can  be  regarded 
as  a  G/G/®  system  where  the  arrival  process  is  the  same  but  the  distribu¬ 
tion  function  of  the  service  time,  G(x)  ,  is  given  by: 
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G(x)  -  PlYj  <  x] 


■  /  -tVj  <  *  I 


£]dP(«.) 


|1  -  J  e_h(Jl)xdP(«)  ,  x  >  0 


,  x  <  0 


(3) 


This  service  time  distribution  function  depends  heavily  on  the  partic¬ 
ular  type  of  the  distribution  function  of  the  marks,  P(*)  ,  and  on  the 
form  of  the  function  h(*)  .  For  instance,  if  h(*)  is  a  step  function, 
for  any  distribution  function  of  the  marks,  G(*)  will  be  the  distribution 
function  of  a  mixture  of  exponentials.  Or,  if  the  function  h(*)  and  the 
random  variable  L  are  such  that  the  random  variable  h(L)  is  normally 

j 1  -  e'X  ,  x  >  0 

distributed  with  mean  zero  and  variance  1/2,  then  G(x)  -  j 

(0  ,  x  <  0 

and  the  service  time,  Y  ,  will  be  a  Weibull  random  variable. 

We  call  this  G/G/°»  system  the  "corresponding  G/G/°>  system"  and 
denote  by  M/G/«®  the  "corresponding  G/G/“  system"  with  a  non-homogeneous 
Poisson  arrival  process. 


2.  FORMAL  SOLUTION  FOR  THE  IDENTIFICATION-ESTIMATION  PROBLEM 


We  have  seen  Chat  regardless  of  Che  marks  our  model  is  equivalent  to  a 
G/G/“  system  with  service  time  distribution  function  given  by  (3),  i.e., 
the  "corresponding  G/G/®  system".  On  the  other  hand, 

G(x)  -  1  -  G(x)  -  P[Y<  >  x] 

E[e“h(L)X] 

1 

assuming  that  h(«)  is  such  that  h(L) 

Theorem  1: 

If  the  random  variable  h(L)  is  positive  and  absolutely  continuous, 
i’e‘*  dFh(L)^  “  fh(L)^dy  *  fh(L)^  e  cl  for  y  >  0  and  if 
G(x)  £  C  in  a  neighborhood  (however  small)  of  +»  .  Then, 

fh(L)(y)  *  lim  Lk,y^(x)]  *  y  >  0  >  (5) 

Ic 

/  v  0>) 

where  L ^  y[G(x)]  ■  y—j  G^  y—j  is  an  operator  defined  for  any 

positive  real  number  y  and  any  large  Integer  k  . 

Proof ; 

By  (4)  and  by  the  assumption  that  h(L)  is  an  absolutely  continuous 
positive  random  variable,  we  get: 


j 


,  x  >_  0 

,  x  <  0  , 


(4) 


is  a  random  variable. 


G(x) 


'  -HO 

Ij  •“yxfh(L)<y>«*y  >  x>0 


,  x  <  0 


(6) 
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i.e.,  G(*)  is  the  Laplace  transform  of  '  7,16  result  thus 

follows  by  a  direct  use  of  a  result  in  Widder  [16,  real  inversion  of  the 
Laplace  transform;  pp.  140  and  141]. 

Furthermore,  if  we  assume  that  P(*)  is  also  known,  then  at  least 
theoretically  we  can  evaluate  h(-)  .  For  example,  if  the  marks,  L  ,  are 
assumed  to  be  uniform  random  variables  in  [0,1]  and  if  h(*)  is  assumed 
to  be  a  non-decreasing  function  defined  on  [0,1]  ,  then 


Fh(L)(y) 

{x  :  the  smallest  value  of  x  so  that  F.  .  .  (x)  y}  , 


0  <y  <  1  . 


Remark  1: 


If  h(L)  is  a  discrete  random  variable,  then  its  distribution  function 

+°° 

Fh(L)  ^  is  a  steP  Unction  and  /  e  yXdFh^(y)  *  G(x)  reduces  to  a 
Dirichelet  series;  see  Widder  [16,  pp.  93  and  94]. 


Remark  2: 


By  Theorem  3.3  in  Widder  [16,  p.  203]  with  a  «  1  ,  we  get  the  following 


result : 


If  G(x)  ~  ~  as  x  -*■  0+  , 


then  lim  J  te_1fh(L)  (t)dt  -  E[{hCL)  }0_1]  -  ; 


where  6-2,3,  ... 


'■**w  mr* 
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Remark  3: 

There  are  several  ways  of  estimating  the  service  time  distribution 

function,  G(*)  ,  according  to  the  data  available.  For  example,  if  the 

data  consist  of  random  observations  of  the  service  times,  y^,  ...,  y^  , 

then  the  empirical  distribution  function,  G  (y. ,  . ...  y  )  ,  is  a  consistent 

n  l  n 

estimator  of  G(x)  .  Brillinger  [2]  obtained  an  estimator  of  the  service 
time  density  function,  g(x)  ■  -  G(x)  ,  based  on  a  stretch  of  arrival  and 
departure  times  (arrival-departure  records)  for  the  stationary  G/G/<” 
system  (having  independent  service  times  with  a  common  finite  mean  value) 
and  Ross  [14]  shows  that,  for  the  GI/G/k  system  with  k  >_  °°  ,  G(x)  is 
identifiable  from  a  single  sample  path  of  the  process  (X(t),t  >_  0}  . 
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3.  THE  HERMIT E  DISTRIBUTION  APPROACH 

Let  the  point  process  {A(t);t  £.0}  have  the  following  properties: 

(i)  £{A(t) }  -  m(t)  <  «•  ,  t  >_  0  , 

(ii)  m  (t)  >  o  and  bounded  on  finite  intervals  for  t  >  0  . 

Definition  4: 

A  point  process  {A(t);t  0}  has  the  order  statistics  property  if 

and  only  if,  given  that  n  jump  times  (points)  occur  in  (0 , t ]  ,  the  con¬ 
ditional  distribution  of  i, ,  . . . ,  i  is  the  same  as  the  distribution  of 

i  n 

the  order  statistics  of  a  random  sample  of  size  n  from  the  distribution 
with  density  function. 


ft(x)  -  »  0<  x<  t  ,  (8) 

The  Poisson  process  is  the  most  familiar  example  of  a  process  with  this 
property,  in  which  ft<x)  «  j  for  xe  [0,t]  (i.e.,  uniform  distribution 

in  [0,1]).  However,  this  does  not  characterize  the  Poisson  process  since, 
for  example,  the  number  of  births  in  a  linear  birth  process  with  parameter 

x 

1  >  0  also  has  the  order  statistics  property  with  f  (x)  -  - -  for 

u  At  1 

e  -  1 

x  e  [0,t]  ,  see  Neuts  and  Resnick  [12].  It  can  be  shown  as  well,  that  the 
non-homogeneous  Poisson  process  also  has  the  order  statistics  property;  see, 
for  example,  Snyder  [15,  p.  65].  Let  m(t)  ,  the  mean  value  function  of  the 
non-homogeneous  Poisson  process,  be  an  absolutely  continuous  function  of  t  , 
and  a  x(t)  its  intensity  function.  Then, 


ft(x)  • 


■\W 

m(t) 


0  <  x  <  t  . 


(9) 
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(For  more  details  on  point  processes  with  the  order  statistics  property,  see 
also  Feigin  [5].) 

In  our  general  model,  let  I(t)  represent  the  number  of  arrivals, 
regardless  of  the  marks,  during  time  interval  (0,t]  and  D(t)  the  number 
of  departures  during  time  interval  (0,t]  ,  regardless  of  the  marks,  among 
the  ones  arriving  during  (0 , t ]  . 

Also  let  X(t)  represent  the  number  of  arrivals,  regardless  of  the 
marks,  still  present  in  the  system  at  time  t  ,  among  the  ones  arriving 
during  time  interval  (0,t]  and  let  M(t)  represent  the  number  of  transi¬ 
tions,  arrivals  and  departures  regardless  of  their  marks,  during  a  fixed 
time  interval  (0,t]  . 


Theorem  2: 

For  the  M/G/®  system  and  for  each  fixed  time  interval  (0,t]  ,  the 
random  variable  N(t)  is  a  Hermit e  variable  with  probability  function 
given  by: 


»[««>.. 1..-M  T  -cr^uTT — 71— 


(10) 


for  n  ■  0,1,  ...  ;  where  [b]  means  the  integer  part  of  b  ;  a^(t)  » 

m(t)(l  -  p)  ;  aj(t)  ■  m(t)p  and  p  -  p(t,h(0 ,P(‘) ,m(*))  ■ 

_i_  )  jj  .-h(0(t-»)dP(t)jd.(ll)  . 


Proof : 

For  each  fixed  time  interval  (0,t]  ,  we  have  for  any  G/G/®  system 


N(t)  -  I(t)  +  D(t)  , 


(ID 
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N(t)  -  X(t)  +  2D(t) 


We  shall  first  prove  that  the  random  variables  X(t)  and  D(t)  are  two 
independent  Poisson  random  variables  and  then  use  this  result  and  the  prob¬ 
ability  generating  function  of  N(t)  ,  E[zN^]  »  to  complete  the  proof  of 
the  theorem. 

For  each  fixed  time  interval  (0,t]  ,  given  that  I(t)  arrivals  had 
occurred,  the  order  statistics  property  of  the  input  process  and  the  assump¬ 
tion  that  the  random  variable  Y  associated  with  each  arrival  is  independ¬ 
ent  of  everything  else  in  the  system  (apart  from  the  mark  carried  out  by 
this  arrival)  allow  us  to  write  X(t)  in  the  following  way: 


x(t)  -  wx(t)  +  ...  +  wI(t)(t) 


Where  the  W^(t)'s  are  a  sequence  of  independent  Bernoulli  random  variables 
defined  as  follows: 


1  ,  if  the  j-th  arrival  which  has  occurred  at  time 


W^t) 


ij  e  [O.t]  ,  is  still  in  the  system  at  time  t 


|  0  ,  if  che  J-Ch  arrival  which  has  occurred  at  time 

lj  e  [O.t]  ,  is  no  longer  in  the  system  at  time 


for  j  ■  1,  ...,  I(t)  .  The  parameter  of  the  Bernoulli  distribution  is 
given  by: 
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PtWj<t) 


1]  -  J  Pt Yj 
0 


>  t  -  u]ft(u)du 


c 

m(t)  J 


[1  -  G(t  -  u)]X(u)du 


'  *(t)  l  [I 


e-h(*.)(t-u)dp(2)jx(u)du 

■  p(t,h(*).P(*),m(*)>  for  j  *  1,  ....  I(t) 


(1A) 


which  is  independent  of  j  .  For  the  sake  of  simplicity,  we  shall  use  "p" 
instead  of  p(t,h(*) ,P(*) ,m(*))  •  Therefore,  the  sequence  {W^(t)  ; 
j  ■  1,  ....  I(t)}  is  a  sequence  of  i.i.d.  Bernoulli  random  variables  of 
parameter  p  .  Then,  for  each  fixed  t  >  0  ,  the  probability  function  of 
the  random  variable  X(t)  is  given  by: 

00 

P[X(t)  -  k]  -  l  P[X(t)  -  k  I  I(t)  -  n]P[I(t)  -  n] 
n*k 

■  l  (£)Pkd  -  p)n  kF[I(t)  -  n] 
n-k  w 

k  oo 

■  £jT  1  n!  (Yn~.P^-t ~  P[I(t)  -  n]  for  k  »  0,1,  ...  .  (15) 


In  the  case  of  a  non-homo geneous  Poisson  process  input,  the  expression  (15) 
reduces  to: 

k 

P(X(t)  -  k]  -  e‘pm(t)  for  k  .  0,1,  ....  (16) 


What  we  have  done  is  to  associate  a  Bernoulli  random  variable  with  each 
arrival  that  occurred  during  the  time  interval  (0,t]  .  If  we  now  inter- 


change  the  role  of  "0"  and  "l"  (success,  failure)  in  Che  Bernoulli  variables. 


Wj(c)  ,  and  follow  exactly  che  sane  steps  as  above,  we  obtain  the  probability 
function  of  the  random  variable  D(t)  ,  which  is  the  same  as  the  probability 
function  of  X(t)  with  p  replaced  by  (1  -  p)  and  (1  -  p)  replaced  by 
P  '• 


P[D(t)  -  k]  -  l  P[D(t)  -  k  |  I(t)  -  n]P[I(t)  -  n] 


n-k 

-  I  (v)(l  -  p)kpn_kP[I(t)  -  n] 
n-k  '  ' 

00  n-k 

-  l  n!  HKt)  -  n]  for  k  -  0,1 . (17) 

In  the  case  of  a  non-homogeneous  Poisson  input,  expression  (17)  reduces  to: 

P[D(t)  -  k]  -  e"<1-p)m(t)  t(-  ~  for  k  -  0,1 .  (18) 


In  the  case  of  non-homogeneous  Poisson  input,  the  independence  of  the  random 
variables  X(t)  and  D(t)  is  well  known  and  easy  to  prove.  Therefore, 

E[zN(t)]  -  E[zX(t)]E[z2D(t)] 

,  em(t)p(z-l)  x  em(t)(l-p)(z2-l) 

_  e[m(t)p(z-l)+m(t)(l-p)(z2-l)) 


This  probability  generating  function  is  known  to  be  the  probability  gener¬ 
ating  function  of  a  Henuite  random  variable.  In  this  case  with  parameters, 
a1(t)  -  m(t)(l  -  p)  and  a2(t)  -  m(t)p  where  by  (14)  p  -  p(t,h(*) ,?(•) , 
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•<•»  [1  •'h<t)<t'u>dP(i)]d’(,,)  • 

i.e. ,  the  probability  function  of  N(c)  is: 


Therefore,  Che  result  follows. 


PtN(t) 


n] 


-m(t) 

e 


ten]  [a.U)]0"^  [a  (t)]j 
j.0  (n  -  2j>!  Ji 


(10) 


n  ■  0,1,  ...  . 

He  notice  that  this  theorem  provides  us  with  two  results  of  independent 
Interest  concerning  infinite  server  systems: 

-  the  theorem  is  valid  for  any  infinite  server  system  of  non-homogeneous 
Poisson  arrival  process  and  general  service  time  distribution  function. 

-  in  the  case  of  an  infinite  server  system  of  general  service  time  dis¬ 
tribution  and  a  "point  process  with  the  order  statistics  property"  as 
the  arrival  process,  the  random  variable  N(t)  does  not  seem  to  be 
Hermite.  Nevertheless,  the  distributions  of  X(t)  and  D(t)  still 
show  a  very  similar  structure  between  themselves.  The  only  difference 
is  the  Interchange  role  of  p  and  (1  -  p)  ;  see  formulae  (15)  and  (17) . 

The  Hermite  distribution  is  a  well  studied  random  variable  with  two 
parameters  a^(t)  and  BgU)  ;  m.l.e.  for  these  parameters  can  be  found 
in  Kemp  and  Kemp  [6,  pp.  386  to  388].  He  can  now  establish  the  following 
result : 

Corollary : 

If  the  form  of  the  function  h(«)  is  assumed  to  be  known  apart  from 

A  A 

a  certain  number  of  unknown  parameters,  then  the  m.l.e.  a^(t)  and  a^(t) 


15 


of  the  Hermlte  distribution,  together  with  the  two  equations  obtained  in 
Theorem  2,  i.e.,  for  each  fixed  t  >.  0  , 


allow  us  to  obtain  m.l.e.  for  the  unknown  parameters  of  the  function  h(*) 
and  for  the  unknown  parameters  of  the  mean  value  function,  m(t)  ,  of  the 
arrival  process,  when  working  with  not  more  than  two  unknown  parameters. 

tfe  note  that  the  data  required  is  just  the  total  number  of  indistin¬ 
guishable  arrivals  and  departures  from  the  system  during  a  fixed  time 
interval. 

To  illustrate  the  method  suggested  by  this  corollary,  we  present  the 
following  example  of  an  application: 


Example  1: 

Let  m(t)  ■  Xt  and  h(<)  be  a  Heaviside  function,  i.e.. 


h(i) 


0 


< 


i  <_  l 
i  >  i 


0 

0 


(21) 


where  >  m2  are  known  positive  real  numbers.  Let  L  be  a  random 
variable  with  known  and  invertible  distribution  function  P(x)  .  The  m.l.e. 
X  ,  lQ  of  che  unknown  parameters  X  and  are  given  in  terms  of  the 
m.l.e.  a^(t)  and  a^Ct)  in  the  following  way: 
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*x<t)  +  *2(t) 


U 

i  .  p1! - U— 

0  l  “Mic 

y2a  -  e  )  -  ux 


-u2t 
(1  -  e  2  ) 


[  V«>  1  -  e'W2tl\ 

[^(0+^(0  w2c  J 


(22) 


Solution; 

By  Theorem  2,  for  each  fixed  t  >  0  , 


a2(t)  »  m(t)p 
t  r+°° 


t  pH» 

If 

0  Lo 


e-h(i)(t-u)dp(i) 


dm(u) 


-U. (t-u) 


-U_(t-u)1 

+  (1  ”  Pn>e  du 


(23) 


where  pQ  -  P(lQ)  -  P[L  <  lQ]  .  And  a^t)  -  At  -  a2(t)  .  Therefore,  if 
aL(t)  and  a2(t)  represent  the  m.l.e.  of  a^t)  and  a2(t)  respectively, 
then 


A  • 


»j(t)  -  a2(t) 


vlu2l 


-Wit 


"u2t 


w2(l  -  e  )  -  MjU  -  e  ) 


1  -  e'^' 

a.(t)  +  a2(t)  P2C 

*  ^  a 


»nni|i  ,mwmm  \.  ■.  ui>*  m 
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(Because  pQ  represents  a  probability,  pQ  -  P[L  <_  2.Q]  ,  we  have  to  have 
0  <.  Pq  <.  1  ;  therefore,  ^  ,  u2  and  the  m.l.e.  a^t)  and  a2(t)  have 
to  be  such  that  the  random  variable  pQ  will  take  values  between  zero  and 
one.) 

On  the  other  hand,  if  the  distribution  function  of  L  ,  P(x)  ,  is  invertible, 
then  pQ  -  P[L  <  4Q3  -  p(^Q)  and  pQ  -  P"1(pQ)  ,  i.e., 

a1(t)  +  a2(t) 
t 

K  -  rl(Po> 

where  represents  the  m.l.e.  of  the  parameter  . 
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4.  DIRECT  OBSERVATIONS  ON  THE  DEPARTURE  PROCESS 


Lee  the  data  consise  of  observations  on  the  departure  process,  namely 
the  number  of  departures,  D(t)  ,  from  the  system  and  the  Instants  of  de¬ 
parture  d^,  . ...  dD^tj  ,  during  a  fixed  time  Interval  [0,t]  .  Let  the 
Input  process  be  a  marked  non-homogeneous  Poisson  process,  of  known  mean 
value  function  m(t)  .  The  following  remarks  In  the  context  of  infinite 
server  queues  will  lead  us  to  the  evaluation  of  some  particular  solutions 
of  the  parametric  and  non-parametric  type.  First,  by  a  well  known  result 
in  the  general  M /G/«  system,  due  to  Mirasol  [11],  the  corresponding  de¬ 
parture  process,  regardless  of  the  marks,  is  a  non-homogeneous  Poisson 
process  of  mean  value  function  m^t)  (in  the  stationary  case  »g(t)  -  m(t)). 
Secondly,  the  result  (18)  permits  us  to  express  mp(t)  In  terms  of  m(*)  , 
h(*)  and  P(*)  . 

mjjU)  -  m(t)  (1  -  p) 


■  m(t) 


t 

j  G(t  -  u)dm(u) 
0 


*  m(t) 


t 

-if 

o  Lo 


-h(i)(t-u) 


dP(i) 


dm(u) 


-  j*  E[1  -  e"h(L)(t"u)]dm(u)  . 
0 


(24) 


The  following  examples  illustrate  the  type  of  parametric  solution  that 


we  can  get  from  (24). 
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Exasttle  1: 

L«t  the  input  process  be  a  marked  Poisson  process,  the  random  variables 
L^'s  be  i.i.d.  and  uniform  in  {0,1]  ,  and  let  the  function  h(*)  be 
h(i)  »  -b  log  i  .  The  mean  value  function  m^(t)  is  given  by: 


«d(o 


-  Xt  -  X  j  J  e(1°8  i)b(t“u)dP(i)jdu 

t 


* Xt  - 1 J  (TTbir- 


bu 


du 


-  Xt  -  X 

b 


(25) 


If 


m^Ct)  is  a  m.l.e.  of  m^t)  ,  the  random  variable  b  defined  by: 


loa  (bt  +  1)  „  Xt  ~  Vt) 


(26) 


is  a  m.l.e.  of  the  paraaMter  b 


The  result  (18)  tell  us  that,  for  each  fixed  time  interval  [0,t]  ,  the 
random  variable  number  of  departures  from  the  system,  D(t)  ,  is  a  Poisson 
random  variable  of  mean  value  m^tt)  and  then  that  the  number  of  departures 
during  [0,t]  is  a  m.l.e.  of  m^U)  . 

Example  2: 

If  in  the  above  exaaqtle  the  mark  L  is  assumed  to  be  a  random  vector, 
i.e.,  L  ■  (L1.  •••»  Lc)  with  the  components  for  i  •  1,  ...,  c 
random  variables  i.i.d.  and  uniformly  distributed  in  [0,1]  .  And  if  h(*) 


vff  ■  ■ 
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is  assumed  co  be  of  a  similar  form  as  in  Che  Example  1  above,  i.e.,  h(L)  - 
-b  log  {  II  L .  )  ,  Chen  we  geC  in  a  similar  manner  a  m.l.e.  for  the  unknown 

\i«l  V 

paramecer  b  . 


^(t)  -  it  -  A  |  Je(lo«  ‘>b<t->dP(l)  x  ...  x  JV1"*  1)b<t-“>dP(.) 


0  Lo 

c 


du 


•  xc  -  a  r - - — 

i  (b(C  -  u)  +  1)' 


du  ;  c  *  2 , 3 ,  • . . 


(27) 


and 


vo 


Ac 


A  [  (b  +  C)1-C  -  11 
b(l  -  c) 


c  *  2,3,  . . . 


(28) 


(where  as  before  (c)  is  Che  random  variable,  number  of  deparcure  sampled 
during  Che  fixed  cime  inCerval  [0,c]). 


Some  Commencs  on  Che  Non-paramecric  Case 

As  before  let  Che  inpuc  be  a  marked  non-homogeneous  Poisson  process  of 
known  incensicy  funecion  A (c)  and  lec  w(t)  be  che  incensicy  funecion  of 
Che  deparcure  process,  p(t)  ■  m^(t)  > 


u(t) 


e-hU)(c-u)dP(0 


A(u)du  . 


(29) 


If  P(*)  is  assumed  to  be  known  and  che  integrals  involved  exist  and  are 
finite, Chen  u(t)  ■  H(t,h(*))  where  the  function  H  is  known  and  given 
by  (29).  Therefore,  if  che  funecion  y(t)  or  an  estimacor  of  it  is  known. 
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at  least  theoretically,  we  should  be  able  to  detect  the  structure  of  h(*) 
from  (29).  Similarly,  If  h(*)  and  u(t)  are  assumed  to  be  known,  then 
we  can  evaluate  exact  or  approximately  the  function  P(*)  from  (29). 

There  are  several  approaches  to  the  problem  of  estimating  the  intensity 
function  p(t)  ,  of  a  non-homogeneous  Poisson  process  (departure  process  of 
the  M/G/°»  system)  from  the  number  of  occurrences  in  a  fixed  time  interval, 
D(t)  ,  and  their  corresponding  occurrence  times,  t^,  ...»  tD£tj.  (For  a 
completely  non-parametric  approach  see  Cleverson  and  Zidek  [3],  where  u(t) 
is  only  required  to  be  positive  and  integrable  on  [-T,T]  for  0  <  T  <_  4®  , 
and  Leonard  [8,  pp.  121  to  123].  Both  authors  make  use  of  the  order 
statistics  property,  defined  on  page  9,  of  the  non-homogeneous  Poisson 
process  to  relate  the  problem  of  estimating  Poisson  Intensity  functions  to 
the  problem  of  estimating  probability  density  functions.  See  also  Cox  [4] 
and  Snyder  {15].) 


(Sj 


f 
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5.  DIRECT  OBSERVATIONS  ON  THE  LENGTH  OF  THE  SERVICE  TIMES 

5.1  Direct  Observations  of  the  Length  of  the  Service  Times  Regardless  of 
Their  Corresponding  Marks 

Let  the  data  available  consist  of  direct  observations  of  the  length  of 
the  service  times  during  a  fixed  time  interval  (0,t]  .  The  expression  (3) 

G(x)  -  1  -  G(x) 

1J  e"h(il)xdPU)  ,  x  >_  0 
° 

1  ,  x  <  0  , 

is  valid  for  an  input  process  which  is  any  general  marked  point  process  and 
allows  us  to  solve  the  following  two  types  of  estimation  problems. 

Parametric  Estimation  of  h(*)  and  P(») 

If  h(*)  and  P(*)  belong  to  a  certain  known  family  of  functions  with 
some  unknown  parameters,  the  expression  (3)  provides  a  method  to  obtain  m.l.e. 
for  these  unknown  parameters. 


Theorem  3: 

Let  the  arrival  process  of  the  "corresponding  G/G/00  system"  be  any 
general  point  process.  Let  h(’)  and  P(*)  be  known  functions  except  for 
a  certain  number  of  unknown  parameters.  Let  the  data  available  consist  of 
direct  observations  of  the  length  of  the  service  times.  Then  the  expression 

1J°  e"ha)xdPU)  ,x>0 

0  ,  allows  us  to  obtain  m.l.e.  for  the 

1  ,  x  <  0 

unknown  parameters  of  h(*)  and  P(>)  . 
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4 


u 


( 


Proof; 

By  hypothesis,  h(*)  and  P(*)  are  known  functions  of  the  parameters 
and  g^,  . ...  g^  respectively.  And  the  density  function  of 
the  service  times,  g(«)  ,  is  g(x)  -  -  for  x  ^  0  .  Therefore,  the 

likelihood  function  of  any  random  sample  of  observed  service  times 
(yj_»  •••.  yfc)  is  given  by: 


Uo^, 


V3!’ 


8n;y 


l* 


*k> 


k 

n  g(y.,) 

i-l  1 


l  T“ 

5  / 

i-l  < 


h(i)e 


-h(i)y 


dP(i) 


(30) 


The  maximum  likelihood  method  can  be  applied,  in  a  very  straightforward  way, 

to  get  m.l.e.  for  a  ,  . . . ,  a  and  6, .....  g  . 

1  m  1  n 


Example  1: 

Let  h(-)  be  the  Heaviside  function  defined  in  (21)  with  JtQ  ,  p 
and  p2  unknown  parameters.  By  replacing  h(*)  by  this  Heaviside  function 
in  (3),  we  get: 


G(x) 


-P,x 

+  (1  -  pQ)e  ;  x  ^  0 

;  x  <  0 


(31) 


where  Pq  ■  P[L  £q]  -  P(£q)  and  the  density  function  of  the  service  time, 
g(x)  ,  is 


g(x) 


"V 

W  + 


u2(l  -  PC 


)e 


-V 


x  >  0 


(32) 


- - - 


3 
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Let  (y^ . .  )  be  a  realization  of  a  random  sample  of  the  length  of  the 

service  time.  A  direct  application  of  the  maximum  likelihood  estimation 

“Vi  . 


method 


\  3UX  *  3u2  *  3P0  ° 

•  --''I) 


where  L(x) 


n  r 

l  log  u 
i-1 


lp0e 


will  provide  us  with  the  m.l.e.  ,  u2  and  pQ  .  If 


the  distribution  function  of  L  ,  P(*)  ,  is  known  and  invertible,  then 
*71  “  P  C Pn )  • 


More  complicated  forms  of  h(*)  could  be  envisaged  and  the  possibility 
of  parametrically  estimating  h(*)  and  also  P(*)  exist;  whether  this  is 
possible  depends  on  our  identif lability  problem  (chosen  shape  of  h(*))  and 
on  the  nature  of  the  known  distribution  function  P(*)  (convergence  of  the 
improper  integrals).  But  the  m.l.e.  of  the  parameters  involved  may  be  dif¬ 
ficult  or  impossible  to  evaluate  analytically,  and  then  they  have  to  be 
obtained  numerically. 

In  comparison  with  the  method  presented  in  Section  3,  the  present 
method  is  much  less  restrictive,  because  the  input  can  be  any  general  marked 
point  process  and  more  than  two  parameters  can  be  estimated  from  the  data. 

In  fact,  we  can  obtain  m.l.e.  for  as  many  parameters  as  we  wish  provided 
that  the  improper  integrals  involved  will  converge  and  that  "1  -  G(>)" 
actually  defines  a  distribution  function.  However,  a  more  complex  type 
of  data  is  required  and  nothing  can  be  learned  about  the  arrival  process. 


Non-Parametric  Estimation  of  P(») 

Let  h(*)  be  a  completely  known  function.  Can  we  get  a  density  esti¬ 
mator  for  the  distribution  function  of  the  marks  from  the  direct  observa¬ 
tions  of  the  length  of  the  service  time?  The  expression  (3)  converts  this 
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problem  to  a  typical  empirical  Bayesian  estimation  problem;  see,  for  instance, 
Robbins  [13]. 

As  a  matter  of  fact,  the  expression  (3)  can  be  rewritten  as  follows: 


(33) 

In  the  terminology  of  the  empirical  Bayesian  theory,  G(x)  is  the  "mixed"  ) 

distribution,  P(*)  is  a  "mixing"  distribution,  and  Gh(£)(*)  is  the  | 

4 

•  4 

known  kernel.  This  theory  provides  us  with  a  method  to  obtain  a  consistent  j 

| 

estimator  of  the  distribution  function  of  the  marks,  P  (•)  .  ■ 

n 

I 

By  using  the  empirical  distribution  function,  Gn(‘)  :  j 

no.  of  terms  y,,y9,  •••»  y_  which  are  x 

y«> - ^-4 — 2 -  <34> 

(which  converges  uniformly  to  G(*)  with  probability  1  as  n  -*■  +°°)  and  the 
functional  equation  (33)  it  is  possible,  at  least  formally,  to  obtain  a 
distribution  function  P  (•)  which  will  converge  as  n  -h»  to  the  unknown 

ft 

distribution  function  P(*)  .  The  degree  of  difficulty  in  getting  this 

estimator  Pn(«)  is  very  much  related  to  the  nature  of  the  known  kernel, 

_h( ? )x 

which  here  we  denoted  by  G^^O)  .  In  our  case,  Gh(£)(x)  *  1  -  e 
Our  problem  can  be  generalized  by  considering  that  the  conditional  distribu¬ 
tion  function  of  the  service  time  of  each  arrival  is  any  other  specified 
distribution  (with  the  basic  parameters  to  be  known  functions  of  the  marks) 


G(x)  -  P[Y  <  x]  -  J  P[Y  1  x  |  L  -  *]dPU) 


/  \W(*HPW  - 
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rather  then  the  exponent iel  distribution  as  assumed  before.  For  more  details 
on  empirical  Bayesian  methods,  see  Merits  [10]. 

Mon-Parametric  Estimation  of  h(«) 

If  ?(•)  is  completely  known,  an  estimator  of  h(>)  can  be  obtained 
by  using  the  results  in  Section  2. 

5.2  Direct  Observations  on  the  Length  of  the  Service  Times  and  Their 
Corresponding  Marks 

Let  us  now  assume  that  a  direct  observation  of  the  marks  as  well  as  of 
the  length  of  the  service  times  can  be  obtained.  In  medical  and  reliability 
data  very  often  this  type  of  data  is  available.  The  data  now  consist  of  n 
pairs  of  positive  real  numbers  ((y^,!^) ,  (y2»l2^  •  ••••  (yn*in))  wh®*1*  the 
first  number  in  the  pair  represents  the  length  of  time  of  the  service  and 
the  second  represents  the  corresponding  mark.  The  likelihood  function  is 
then  given  by: 

n  -h(Oy. 

L^yl,A2*y2,42*  yn*n^  “  11  h^i^e  2 > 


and 


log  k^yj_,^’i*y2 » ^2* 


yn.*> 

n  n 


n  n 

I  log  h(i  )  -  l  h(fc ,)y. 
i-1  1  i-1  11 


(43) 


Let  ,  ...,  I ^  for  i^  n  be  the  k  distinct  values  of  8. 

X1  k 

among  the  n  observed.  Let  y.  y  .  for  r.  .  <  n  and 

k  ’  J  (J)’  J  (J> 

]  ■  1,  ...,  k  and  £  r,,.  *  n  be  the  values  of  the  observed  service 

j-1 
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times,  y's  ,  of  mark  t 


Let  y. 


r(J) 

i»  y-‘, 

r<j) 


be  ics  sample  average 


service  time.  In  our  model  given  the  value  of  che  mark,  for  instance  t.  , 

j 

the  corresponding  length  of  the  service  time  is  an  exponential  random  var¬ 
iable  of  parameter  w  -  h(i.  )  .  The  m.l.e.  of  the  parameter  u  is  the 

J  j  J 

inverse  sample  average  (y^)”*"  *  Therefore,  if  in  our  sample  we  plot  the 

values  1.  for  j  ■  1,  ...,  k  against  the  corresponding  Inverse  sample 
j 

averages  (y.j)_^  »  we  8eC  some  empirical  information  about  the  form  of  the 
function  h(*)  .  Thus  to  estimate  h(*)  with  this  type  of  data  we  suggest 
to  use  data  in  two  stages:  first,  to  learn  about  the  form  of  the  function 
in  the  way  presented  above  and  to  choose  a  suitable  parametric  representa¬ 
tion  for  h(*)  and  secondly  to  obtain  through  (41)  m.l.e.  for  the  parame¬ 
ters  of  h(*)  . 


We  note  that  if  in  our  model  the  marks  are  ,  i  ■  1,2  and  if  they 

are  interpreted  as  denoting  respectively  "failure"  and  "censoring"  or 
"withdrawn"  in  the  context  of  reliability  theory  then  the  Bayesian  statis¬ 
tical  results  presented  in  Barlow  and  Proschan  [1]  can  be  used  (in  their 
paper  the  underlying  probabilistic  model  is  of  the  G/G/®  type;  the  observed 
individuals  enter  into  the  system,  stay  there  for  a  certain  time  (lifetime) 
and  then  leave  without  interacting  among  themselves). 
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FINAL  REMARKS 

The  conditional  distribution  of  the  service  time,  PtY^  <  x  |  1^  *  l]  , 
do  not  need  to  be  exponential,  except  for  Theorem  1. 

No  attempt  has  been  made  to  study  the  performance  of  the  various  types 
of  estimators  presented  and  suggested  in  this  paper.  The  reason  is  that  the 
problem  is  too  complicated  and  we  are  just  beginning  to  understand  it. 
However,  its  close  relationship  with  areas  traditionally  considered  to  be 
unrelated  has  been  noted  in  this  paper.  To  our  mind,  these  relationships 
deserve  further  attention. 
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Footnotes 

OD 

(a)  C  -  means  the  class  of  the  continuous  functions  with  all  derivatives. 

(b)  -  means  the  k-th  derivative  of  G  . 
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